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Abstract 

In this paper we present a direct adaptive control method for a class of uncertain nonlinear 
systems with a time-varying structure. We view the nonlinear systems as composed of a finite 
number of "pieces," which are interpolated by functions that depend on a possibly exogenous 
scheduling variable. We assume that each piece is in strict feedback form, and show that 
the method yields stability of all signals in the closed-loop, as well as convergence of the 
state vector to a residual set around the equilibrium, whose size can be set by the choice of 
several design parameters. The class of systems considered here is a generalization of the class 
of strict feedback systems traditionally considered in the backstepping literature. We also 
provide design guidelines based on C^yo bounds on the transient. 

1 Introduction 

The field of nonlinear adaptive control developed rapidly in the last decade. The paper |jl|] and 
others gave birth to an important branch of adaptive control theory, the nonlinear on-line function 
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approximation based control, which includes neural (e.g., in 0) and fuzzy (e.g., in 0) approaches 
(note that there are several other relevant works on neural and fuzzy control, many of them cited 
in the references within the above papers). The neural and fuzzy approaches are most of the time 
equivalent, differing between each other only for the structure of the approximator chosen [Q. Most 
of the papers deal with indirect adaptive control, trying first to identify the dynamics of the systems 
and eventually generating a control input according to the certainty equivalence principle (with some 
modification to add robustness to the control law), whereas very few authors (e.g., in 0, ^) use the 
direct approach, in which the controller directly generates the control input to guarantee stability. 

Plants whose dynamics can be expressed in the so called "strict feedback form" have been con- 
sidered, and techniques like backstepping and adaptive backstepping have emerged for their 
control. The papers 0, present an extension of the tuning functions approach in which the 
nonlinearities of the strict feedback system are not assumed to be parametric uncertainties, but 
rather completely unknown nonlinearities to be approximated on-line with nonlinearly parameter- 
ized function approximators. Both the adaptive methods in and in |^ attempt to approximate 
the dynamics of the plant on-line, so they may be classified as indirect adaptive schemes. 

In this paper, we have combined an extension of the class of strict feedback systems considered 
in 1^, with the concept of a dynamic structure that depends on time, so as to propose a class of 
nonlinear systems with a time- varying structure, for which we develop a direct adaptive control ap- 
proach. This class of systems is a generalization of the class of strict feedback systems traditionally 
considered in the literature. Moreover, the direct adaptive control developed here is, to our knowl- 
edge, the first of its kind in this context, and it presents several advantages with respect to indirect 
adaptive methods, including the fact that it needs less plant information to be implemented. 
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2 Direct Adaptive Control 

Consider the class of continuous time nonlinear systems given by 

R 
R 

in = 5^Pi(t;) (0{(X„) + iji{X^)u) (1) 

i=i 

where i = 1, 2, . . . , — 1, Xi = [xi, . . . , Xi]^ , and X„ G M" is the state vector, which we assume 
measurable, and u G M is the control input. The variable f G M'^ may be an additional input 
or a possibly exogenous "scheduling variable." We assume that v and its derivatives up to and 
including the (n — ly^ one are bounded and available for measurement, which may imply that v 
is given by an external dynamical system. The functions pj, j = 1,. . . ,R may be considered to 
be "interpolating functions" that produce the time- varying structural nature of system (|l]), since 
they combine R systems in strict feedback form (given by the (pl and ipj functions, i = 1, . . . ,n, 
j = 1 . . . ,R) and the combination depends on time through the variable v (thereby, the dynamics 
of the plant may be different at each time point depending on the scheduling variable). Here, we 
assume that the functions pj are n times continuously different iable, and that they satisfy, for all 

< oo. Denote for convenience (f)f{Xi,v) = J2f=i Pji'^)4>i{^i) 
and '?/'j^(Xj, t>) = J2f=i Pji'^)i^ii-^i)- We will assume that 0f and ipi are sufficiently smooth in their 
arguments, and that they satisfy, for all Xj G and v G M'^, i = l,...,n, 0^(0, f) = and 

tP'r{Xi,v)y^O. 

Here, we will develop a direct adaptive control method for the class of systems (0). We assume 
that the interpolation functions pj are known, but the functions (pl and ip'j^ (which constitute the 
underlying time- varying dynamics of the system) are unknown. In an indirect adaptive methodology 
one would attempt to identify the unknown functions and then construct a stabilizing control law 
based on the approximations to the plant dynamics. Here, however, we will postulate the existence 
of an ideal control law (based on the assumption that the plant belongs to the class of systems 
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(0)) which possesses some desired stabihzing properties, and then we devise adaptation laws that 
attempt to approximate the ideal control equation. This approximation will be performed within 
a compact set Sx„ C M" of arbitrary size which contains the origin. In this manner, the results 
obtained are semi-global, in the sense that they are valid as long as the state remains within Sx„, 
but this set can be made as large as desired by the designer. In particular, with enough plant 
information it can be made large enough that the state never exits it, since, as will be shown a 
bound can be placed on the state transient. Furthermore, as will be indicated below, the stability 
can be made global by using bounding control terms. 

For each vector Xi we will assume the existence of a compact set S^^ C W specified by the 
designer. We will consider trajectories within the compact sets 5^., i = 1, . . . ,n, where the sets 
are constructed such that 5^. C ^^^i+i, for i = 1, . . . , n — 1. We assume the existence of bounds ip^., 

G M, and ipi^^ G M, i = 1, . . . , n {not necessarily known), such that for all v E W and Xi G Sx^, 
i = l,...,n, 



R 



E 



dpjiv) 
dv 



v^l{Xi) + p,{vf-^i^Xi 



(2) 



This assumption implies that the affine terms in the plant dynamics have a bounded gain and a 
bounded rate of change. Since the functions ipl are assumed continuous, they are therefore bounded 
within iSa;-. Similarly, note that even though the term |Xj| may not necessarily be globally bounded, 
it will have a constant bound within Sx^ due to the continuity assumptions we make. Therefore, 
assumption (^) will always be satisfied within S^^ . Moreover, in the simplest of cases, the first part 
of assumption is satisfied globally when the functions tpl are constant or sector bounded for all 
Xi G W. 

The class of plants (|I]) is, to our knowledge, the most general class of systems considered so 
far within the context of adaptive control based on backstepping. In particular, in both and 
0, 0, which are indirect adaptive approaches, the input functions ipl are assumed to be constant 



for i = 1, . . . ,n. This assumption allows the authors of those works to perform a simpler stability 
analysis, which becomes more complex in the general case 0. Also, the addition of the interpolation 
functions pj, j = 1,. . . ,R, extends the class of strict feedback systems to one including systems 
with a time- varying structure , as well as systems falling in the domain of gain scheduling (where 
the plant dynamics are identified at different operating points and then interpolated between using 
a scheduling variable). Note that if we let i? = 1 and pi{v) = 1 for all v, together with ipf = 1, 
z = 1, . . . , n, we have the particular case considered in @, 0]. 

The direct approach presented here has several advantages with respect to indirect approaches 
such as in ^, |^. In particular, bounds on the input functions ipj are only assumed to exist, 
but need neither to be known nor to be estimated. This is because the ideal law is formulated so 
that there is not an explicit need to include information about the bounds in the actual control 
law. Moreover, although assumption (|^) appears to be more restrictive than what is needed in the 
indirect adaptive case, it is in fact not so due to the fact that the stability results are semi-global 
(i.e., since we are operating within the compact sets Sx„, continuity of the affine terms automatically 
implies the satisfaction of the second part of assumption @). 

2.1 Direct Adaptive Control Theorem 

Next, we state our main result and then show its proolQ For convenience, we use the notation 
Ui=[v,v,..., v^'-^^] e W\ i = 1, . . . , n. 

Theorem 1: Consider system (|I]) with the state vector X„ measurable and the scheduling 
matrix z/„__i measurable and bounded, together with the above stated assumptions on (pl, ipf and pj, 
and (^. Assume also that ^'j(O) G S^. C M"^^*, -^^(0) G S^^ C W, i = 1, . . . ,n, where S^. and S^^ are 
compact sets specified by the designer, and large enough that z/j andXi do not exit them. Consider the 
diffeomorphism zi = xi, Zi = i = 2, . . . , n, with di(Xj, z/j) = X]f=i Pj{v)9^jC,^j (X^, Vi) 

and Q;|(zj,2j_i) = —kiZi — Zi_i, with ki > and Zq = 0. Assume the functions ( j{Xi, z/j) to be at 

i 

^We will generally omit the arguments of fmictions for brevity. 
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least n — i times continuously differentiahle, and to satisfy, for i = 1, . . . ,n, j = 1, . . . , R, 

" < oo. (3) 



Consider the adaptation laws for the parameter vectors 6 j E M. , N j E N, 9 j = —pj'j jC — 

i i i i i 

jO J , where •y j > 0, a j > 0, i = 1, . . . ,n, j = 1, . . . , R are design parameters. Then, the control 

i i i i 

law u = an + c^n guarantees boundedness of all signals and convergence of the states to the residual 
set 

( Jl^ ^ 2tlj Wd] 

Vd=lXr,E^-:^^z^<^^\. (4) 

where = mini<j<„ ipf, (3d is a constant, and Wd measures approximation errors and ideal pa- 
rameter sizes, and its magnitude can he reduced through the choice of the design constants ki, 'y j 

i 

and a j . 

Proof: The proof requires n steps, and is performed inductively. First, let zi = xi, and 
Z2 = X2 — &i — al, where di is the approximation to an ideal signal al ("ideal" in the sense that 
if we had di = al we would have a globally asymptotically stable closed loop without need for the 
stabilizing term af), and will be given below. Let Ci > be a constant such that Ci > and 
al{xi,v) = (—01 — ciZi) . Since the ideal control al is smooth, it may be approximated with 
arbitrary accuracy for v and Xi within the compact sets S^-^ C M"^ and S^^ C M, respectively, as 
long as the size of the approximator can be made arbitrarily large. 

For approximators of finite size let a*(xi,f) = "^f^i Pj{v)9*] (^j {v, xi) + 5ai{v,xi), where the 

N j 

parameter vectors 0*^ G M °i , N^j E N, are optimum in the sense that they minimize the represen- 
tation error over the set S^^ x S^-^ and suitable compact parameter spaces fi^j, and (^j^{xi,v) 
are defined via the choice of the approximator structure (see [0] for an example of a choice for 



C j). The parameter sets Q j are simply mathematical artifacts. As a result of the stability proof 

i 1 

the approximator parameters are bounded using the adaptation laws in Theorem |l], so Q^j does 
not need to be defined explicitly, and no parameter projection (or any other "artificial" means of 
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keeping the parameters bounded) is required. The representation error arises because the sizes 
N^j are finite, but it may be made arbitrarily small within Sx^ x S^^ by increasing N^j (i.e., we as- 

i i 

sume the chosen approximator structures possess the "universal approximation property"). In this 
way, there exists a constant bound > such that |5q,J < d^-^ < oo. To make the proof logically 
consistent, however, we need to assume that some knowledge about this bound and a bound on 
6'*^ are available (since in this case it becomes possible to guarantee a priori that Sx^ x S^-^ is large 
enough). However, in practice some amount of redesign may be required, since these bounds are 
typically guessed by the designer 

Let = — 6^*^ denote the parameter error, and approximate with ai{xi,v, 6^j; j = 
Pj{v)9^ ,C,Axi,v) . Hence, we have a linear in the parameters approximator with 
parameter vectors d^j^. Note that the structural dependence on time of system (|l|) is refiected in 
the controller, because di can be viewed as using the functions Pjiy) to interpolate between "local" 
controllers of the form ^^^(^^j (xi, f ), respectively. Notice that since the functions pj are assumed 
continuous and v bounded, the signal di is well defined for all v G S^^ . 

Consider the dynamics of the transformed state, ii = 0^ + ipl{z2 + di + a\) + ipl^al — a\) = 
-cizi + i)lz2 + - al) + i)lal = -cizi + i)lz2 + i)l (Ef=i Pj^ZiiCa{ - '^ai) + Let Vi = 

iTTEz'i + i -I — — and examine its derivative, Vi = _|_ _lk — L_ Using the 

2 ■ i ^ i 

expression for ii, Vi = -^ + ziZ2 + zi Y.f=i Pj^ljXa{ "^i^oj + " |^i:|^ + Ej^=i °'y • Choose 
the adaptation law 6^j^ = <i>^j = -Pjla{(a{^^ ~ '^a{^a{' "^^^^ design constants > 0, cr^j > 0, 
j = 1, . . . ,i? (we think of cr^jO^j as a "leakage term"). Also, note that for any constant ki > 0, 
< kiMai < hzj + We pick af = -kiZi. 
Notice also that, completing squares, —^~^j9 i = — ($ , +9*j) < r 1 — Finally, 

Oi-^ 1 Oij^ 1 Oi-^ 

observe that (^ci + < (^ci - < with ci = ci - ^ > 0. Then, we obtain 

Vi < -~nr - I Ylj=i + ^1^2 + ^ + I Ef=i This completes the first step of the 

proof. 
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We may continue in this manner up to the n*^ step[|, where we have = Xn — «n-i ~ 
a;^__]^, with d„_i and a^.^ defined as in Theorem |l]. Consider the ideal signal a*(X„,z/„) = 

\ ~ ^nZn + Oi-n-i + (^t-i) with c„ > Notice that, even though the terms 9 i appear 

in a* through the partial derivatives in 9 j does not need to be an input to a*, since the 

n— 1 

resulting product of the partial derivatives and 9 3 can be expressed in terms of zi, . . . , Zn-i, v 

n — l 

and a j q;„_i. To simplify the notation, however, we will omit the dependencies on inputs other 

n — l 

than Xi and Ui, but bearing in mind that, when implementing this method, more inputs may be 
required to satisfy the proof. Also, note that by assumption (^, < oo for bounded arguments. 
Therefore, we may represent a*^ with a*(X„,i^„) = Ylj=i Pj{v)9*J Caii^n, i^n) + 5a„{Xn, i^n) for 
Xn e C M" and z/„ G Sy^ C M''^". The parameter vector 9*^ E M^^n, N j G N is an optimum 
within a compact parameter set flan: iii a sense similar to 9*j, so that for (X„, z/„) G iS^^^ x Sv„, 
\Sa \ < da < oo for some bound da > 0. Let $ j = 9 j — 9* , , and consider the approx- 
imation dn as given in Theorem |l]. The control law m = d„ , + yields i„ = (/)^ + ^^(on + 

O - An-l - + V-^la; - O = -CnZn + i^n (Ef=l (^) Q - + i^n<- ChoOSe the 



Lyapunov function candidate V = Vn-\ + 2^2;^ + | X]j=i and examine its derivative. 



tiveiy that K-i < - e::^ f - 1 EiT^ E^Li ^ + -n-i^. + EiT^ t + 1 S^^i 



with constants Cj = Cj — > 0, % = l,...,n. The choice of adaptation laws for 9^j and 
of in Theorem 01, together with the observations that — ^$ ' 6' j < — — — h 



2n^„. < knz'i + ^, with fcn > and ( + 1^ ) < imply 



-4 + fe, with K > and -f (c. + ^ j < 

1=1 ' 1=1 j=i "i 



where Wa contains the combined effects of representation errors and ideal parameter sizes, and is 
given by W, = Eti Ef=i Note that if Eti '^>W,o.\ Eti Ef=i ' ^ > 



Wd, then we have V < 0. Furthermore, letting ip^ = mini<j<„(-?/^p, ipm = ^8.xi<i<n{4'i) , and 
^We omit intermediate steps for brevity. 



defining cq = mini<i<„(Q), = |^ and ao = T^^T^i<i<n,i<j<R (cr^j^ we have - ZlILi ^ ^ 

c I'l' 'P 

v^n z2 _ „ ^2 ^2 ^2 ^ ^ < 

~Co2^i=i3;jr - -Co2^j=i^-T^ S -Co 2^i=i^7n; S -Co^m 2^,=! ^ ana -2 Z^i=iZ^,=i'^„J^7— S 



I* iP 

''^oi Zir=i Z]j=i Then, letting /3d = min(2coV'm, (^o), we have that if 



j=i i=i j=i '^i 

with Vo = then ^ < and all signals in the closed loop are bounded. Furthermore, we 
have V < -PaV + Wa, which implies that < V{t) < ^ + (v{0) - e"^''* so that both the 
transformed states and the parameter error vectors converge to a bounded set. Finally, we conclude 
from the upper bound on V{t) that the state vector converges to the residual set (^). □ 

Remark 1: The representation error bounds and the size of the ideal parameter vectors are 
assumed known, since they affect the size of the residual set to which the states converge. It is 
possible to augment the direct adaptive algorithm with "auto-tuning" capabilities (similar to |]^), 
which would relax the need for these bounds. 

Furthermore, note that the stability result of Theorem |1| is semi-global, in the sense that it is 
valid within the compact sets iS„, and Sx^, i = 1, . . . ,n, which can be made arbitrarily large. The 
stability result may be made global by adding a high gain bounding control term to the control 
law. Such a term may be particularly useful when, due to a complete lack of a priori knowledge, 
the control designer is unable to guarantee that the compact sets S^^, i = 1, . . . , n, are large enough 
so that the state will not exit them before the controller has time to bring the state inside P^; 
moreover, it may also happen that due to a poor design and poor system knowledge, is not 
contained in Sx„- In this case, too, bounding control terms may be helpful until the design is 
refined and improved. However, using bounding control requires explicit knowledge of functional 
upper bounds of lipi^v, Xi)\, and also of the lower bounds ip'^, i = 1, ■ ■ ■ ,n, whose knowledge we do 
not mandate in Theorem |l[ Bounding terms may be added to the diffeomorphism in Theorem |l|, 
but we do not present the analysis since it is similar to the one we present here and it is algebraically 
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tedious; we simply note, though, that the bounding terms have to be smooth (because they need 
to be differentiable) , so they need to be defined in terms of smooth approximations to the sign, 
saturation and absolute value functions that are typically used in this approach. 

Remark 2: If the bounds ip':, ipl and ip^^ are known, it becomes possible for the designer to di- 
rectly set the constants Cj in the control law. Notice that with knowledge of these bounds, the term 
ip is also known, and we can pick constants Cj such that Cj > Define the auxiliary functions rji = 
CiZi. We may explicitly set the constant c, in a* if we let rji be an input to the i*^ approximator struc- 
ture, i.e., if we let a*{Xi, z/j, Xr,,Vi) = Ylf=i Pi(^)^*IO i^i^ Xr,,r]i) + ^a,- Then, the approxima- 
tors used in the control procedure are given by ai{Xi, z/j, X^., rji) = '^f=i Pj{'v)0~^jCa^ i^iy ^i-, ^ri-, Vi) 
and the stability analysis can be carried out as expected. 



2.2 Performance Analysis: £00 Bounds and Transient Design 

The stability result of Theorem |I| is useful in that it indicates conditions to obtain a stable closed- 
loop behavior for a plant belonging to the class given by (|l]). However, it is not immediately 
clear how to choose the several design constants to improve the control performance. Here we 
concentrate on the tracking problem, and present design guidelines with respect to an £00 bound 
on the tracking error. We are interested in having Xi track the reference model state of the 
reference model x^. = x^..^^, i = 1,2, ...,n — 1, x^ = fr{Xrn,r) with bounded reference input 
r(t) G M. Now, we need to use the diffeomorphism zi = xi — Xr^, Zi = Xi — — Q;|_i, i = 2, . . . ,n 
with al{xi, V, in) = ;^ (-05 " ^iZi + x^J and a*{Xi, Ui, XrJ = - CiZi + di + d- j for i = 

2, . . . , n. The stability proof needs to be modified accordingly, and it can be shown that the tracking 
error \xi — x^l converges to a neighborhood of size W — . 

From the upper bound on V{t) we can write V{t) < ^ + y(0)e~^''*. From here, it follows that 
I ELi H < I? + (i ELi li + I ELi ^) The terms ..(0) depend on the 

design constants in a complex manner. For this reason, rather than trying to take them into account 
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in the design procedure, we follow the trajectory initialization approach taken in 0, which allows 
the designer to set Zi{0) = 0, i = 1, . . . , n by an appropriate choice of the reference model's initial 
conditions. In our case, in addition to the assumption that it is possible to set the initial conditions 
of the reference model, we will have to assume certain invertibility conditions on the approximators. 
In particular, since -2i(0) = Xi(0) — ^^^(O), for ;zi(0) = we need to set ^^^(O) = Xi(0). 

For the i^^ transformed state Zi, i = 2, . . . ,n, Zj(0) = Xj(0) — di_i(0) — a.f_]^(0). Notice that 
ai_i(0) = a;j*_i(zj_i(0), Zj__2(0)), so that if Zi_i(0) = and 2:4-2(0) = we have a^_^{0) = 0. 
In particular, notice that this holds for i = 2. In this case, to set 2:2(0) = we need to have 
ai{xi{0),v{0),Xr2{0)) = ^2(0). This equation can be solved analytically (or numerically) for XriiO) 



provided 



7^ 0. This is not an unreasonable condition, since it depends on the choice of 

t=o 



approximator structure the designer makes. The structure can be chosen so that it satisfies this 
condition. Granted this is the case, it clearly holds that a|(0) = 0, and the same procedure can be 
inductively carried out for i = 3, . . . , n, with the choices dj_i(Xj_i(0), z/j_i(0), a;ri(0)) = Xj(0). 

This procedure yields the simpler bound Yl^=i ^ii't) ^ ^"/jj'^'^ ~'~^m ^^i=i ^j=i ~7~ — ^ e"^'**. 
We would like to make this bound small, so that the transient excursion of the tracking error is 
small. Notice that we do not have direct control on the size of (3^, since this term depends on the 
unknown constants Cj, which appear in the ideal signals a*. Even though it is not necessary to be 
able to set Pd to reduce the size of the bound, it is possible to do so if the bounds ip':, ip'^ and ipf^ 
are known. 

At this point, it becomes more clear how to choose the constants to achieve a smaller bound. 
Recalling the expression of Wd, note that, first, one may want to have /J^ > 1, so that Wd is not 
made larger when divided by (3d, and so that the convergence is faster. This may be achieved by 
setting Cj such that 2ciil)„i > 1 (if enough knowledge is available to do so) and a j > 1. However, 

i 

having large a j makes Wd larger; this can be offset, however, by also choosing the ratio a j /7 j < 1 

i i i 

or smaller. Finally, it is clear that making ki larger reduces the effects of the representation errors, 
and therefore makes Wd smaller. Observe that there is enough design freedom to make Wd small 
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and /3d large independently of each other. 

These simple guidelines may become very useful when performing a real control design. More- 
over, notice that the bound on Y^^=i^ii'^) makes it possible to specify the compact sets of the 
approximators so that, even throughout the transient, it can be guaranteed that the states will 
remain within the compact sets without the need for a global bounding control term. This has been 
a recurrent shortcoming of many on-line function approximation based methods, and the explicit 
bound on the transient makes it possible to overcome it. 

3 Conclusions 

In this paper we have developed a direct adaptive control method for a class of uncertain nonlinear 
systems with a time-varying structure using a Lyapunov approach to construct the stability proofs. 
The systems we consider arc composed of a finite number of "pieces," or dynamic subsystems, which 
are interpolated by functions that depend on a possibly exogenous scheduling variable. We assume 
that each piece is in strict feedback form, and show that the methods yield stabihty of all signals in 
the closed-loop, as well as convergence of the state vector to a residual set around the equilibrium, 
whose size can be set by the choice of several design parameters 

We argue that the direct adaptive method presents several advantages over indirect methods 
in general, including the need for a smaller amount of information about the plant and a simpler 
design. Finally, we provide design guidelines based on C^^i bounds on the transient and argue that 
this bound makes it possible to precisely determine how large the compact sets for the function 
approximators should be so that the states do not exit them. 
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